Linear piecewise-deterministic Markov processes with families of random discrete events
نویسندگان
چکیده
We consider a class of piecewise-deterministic Markov processes where the state evolves according to a linear dynamical system. This continuous time evolution is interspersed by discrete events that occur at random times and change (reset) the state based on a linear affine map. In particular, we consider two families of discrete events, with the first family of resets occurring at exponentially-distributed times. The second family of resets is generally-distributed, in the sense that, the time intervals between events are independent and identically distributed random variables that follow an arbitrary continuous positively-valued probability density function. For this class of stochastic systems, we provide explicit conditions that lead to finite stationary moments, and the corresponding exact closed-form moment formulas. These results are illustrated on an example drawn from systems biology, where a protein is expressed in bursts at exponentiallydistributed time intervals, decays within the cell-cycle, and is randomly divided among daughter cells when generallydistributed cell-division events occur. Our analysis leads to novel results for the mean and noise levels in protein copy numbers, and we decompose the noise levels into components arising from stochastic expression, random cell-cycle times, and partitioning. Interestingly, these individual noise contributions behave differently as cell division times become more random. In summary, the paper expands the class of stochastic hybrid systems for which statistical moments can be derived exactly without any approximations, and these results have applications for studying random phenomena in diverse areas.
منابع مشابه
On the Hamiltonian structure of large deviations in stochastic hybrid systems
We develop the connection between large deviation theory and more applied approaches to stochastic hybrid systems by highlighting a common underlying Hamiltonian structure. A stochastic hybrid system involves the coupling between a piecewise deterministic dynamical system in Rd and a time-homogeneous Markov chain on some discrete space Γ. We assume that the Markov chain on Γ is ergodic, and tha...
متن کاملLimit theorems for infinite - dimensional piecewise deterministic Markov processes . Applications to stochastic excitable membrane models ∗
We present limit theorems for a sequence of Piecewise Deterministic Markov Processes (PDMPs) taking values in a separable Hilbert space. This class of processes provides a rigorous framework for stochastic spatial models in which discrete random events are globally coupled with continuous space-dependent variables solving partial differential equations, e.g., stochastic hybrid models of excitab...
متن کاملDynamic Frailty and Change Point Models for Recurrent Events Data
Abstract. We present a Bayesian analysis for recurrent events data using a nonhomogeneous mixed Poisson point process with a dynamic subject-specific frailty function and a dynamic baseline intensity func- tion. The dynamic subject-specific frailty employs a dynamic piecewise constant function with a known pre-specified grid and the baseline in- tensity uses an unknown grid for the piecewise ...
متن کاملPersistent random walks , variable length Markov chains and piecewise deterministic Markov processes ∗
A classical random walk (St, t ∈ N) is defined by St := t ∑ n=0 Xn, where (Xn) are i.i.d. When the increments (Xn)n∈N are a one-order Markov chain, a short memory is introduced in the dynamics of (St). This so-called “persistent” random walk is nolonger Markovian and, under suitable conditions, the rescaled process converges towards the integrated telegraph noise (ITN) as the time-scale and spa...
متن کاملOptimal Control of Piecewise Deterministic Markov Processes with Finite Time Horizon
In this paper we study controlled Piecewise Deterministic Markov Processes with finite time horizon and unbounded rewards. Using an embedding procedure we reduce these problems to discrete-time Markov Decision Processes. Under some continuity and compactness conditions we establish the existence of an optimal policy and show that the value function is the unique solution of the Bellman equation...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
- CoRR
دوره abs/1711.04884 شماره
صفحات -
تاریخ انتشار 2017